APPLICATION FOR 
UNITED STATES PATENT 
IN THE NAMES OF 



PRESTON J. HUNT 
AND 

MATTHEW A. BRIGHT 



FOR 



METHOD & APPARATUS FOR INTELLIGENT AND AUTOMATIC 
PREFERENCE DETECTION OF MEDIA CONTENT 



Prepared By: 

PILLSBURY MADISON & SUTRO LLP 
Ninth Floor, East Tower 
1100 New York Avenue, N.W. 
Washington, D.C. 20005-3918 
Telephone (213) 488-7100 
Facsimile (213) 629-1033 



Attorney Docket No: 81674-273214 
Client Reference No.: P-9894 



Express Mail No. EL 669 015 672 US 



PATENT 
81674-273214 

BACKGROUND OF THE INVENTION 

FIELD OF THE INVENTION 

The present invention relates generally to the art of passive preference detection, and 
more particularly to a system, method, and apparatus for automatically determining the media 
content preferences of a user who downloads streaming media content via the Internet. 
DESCRIPTION OF THE RELATED ART 

There are music-distribution systems in the art that record the music preferences of the 
users of such systems, and play back songs based on those preferences. There are also Internet 
sites, for example, that allow users to manually assign a score to songs, where the score reflects 
the user's enjoyment of the song. Based on the user's scores, such sites intelligently select songs 
to send to the user that the user is likely to enjoy. 

Such systems have major drawbacks, however, because a score must be manually entered 
for each song. Entering scores is very cumbersome and may be very confusing for new or 
unsophisticated users. Moreover, in a portable environment, such as in a car or on a portable 
player, such an elaborate controller may be difficult and/or costly to implement. 

Also, such systems only use each particular user's scores when calculating which songs 
to send to that particular user. A drawback of this approach is that such a system may only select 
songs that user will like with any degree of accuracy after that user has already entered scores for 
a large number of songs. 

Accordingly, a preference detection system is desired that does not require a user to 
manually score songs. A system capable of passively determining a user's music preferences is 
therefore desired. Such a system should be capable of learning a user's preferences based on the 
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user's responses (such as forwarding to the next song, etc.) while each song plays. Such a 
system should work not only with music, but also with other types of media (video, etc.). 

A preference detection system is also desired that learns which songs to send a user not 
only based upon that user's responses, but also based upon the responses of other users to similar 
5 songs, as patterns may appear when data from enough users is analyzed. 
DESCRIPTION OF THE DRAWINGS 

FIG. 1 illustrates an automatic preference detection system according to an embodiment 
of the present invention; 

FIG. 2 is a flow chart illustrating the initialization of the automatic preference detection 
Q10 system when a user first signs up for the service according to an embodiment of the present 
^=1 invention; 

^ FIG. 3 is a flow chart illustrating the processing that occurs when a user is logged into the 

01 

automatic preference detection system according to an embodiment of the present invention; 

tar 

l^g. FIG. 4a is a diagram illustrating the relationship between a first song and four of the first 
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1=5, 1 5 song's attributes before system learning according to an embodiment of the present invention; 

p FIG. 4b is a diagram illustrating the relationship between the first song and four of the 

O 

first song's attributes after system learning according to an embodiment of the present invention; 

FIG. 4c is a diagram illustrating the relationship between a second song and four of the 
second song's attributes before system learning according to an embodiment of the present 
20 invention; 

FIG. 4d is a diagram illustrating the relationship between the second song and four of the 
second song's attributes after system learning according to an embodiment of the present 
invention; 
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FIG. 4e is a diagram illustrating the relationship between a third song and four of the 
third song's attributes before system learning according to an embodiment of the present 
invention; 

FIG. 4f is a diagram illustrating the relationship between the third song and four of the 
third song's attributes after system learning according to an embodiment of the present 
invention; 

FIG. 4g is a diagram illustrating the relationship between a fourth song and four of the 
fourth song's attributes before system learning according to an embodiment of the present 
invention; 

FIG. 4h is a diagram illustrating the relationship between the fourth song and four of the 
fourth song's attributes after system learning according to an embodiment of the present 
invention; 

FIG. 4i is a diagram illustrating the relationship between the four songs in FIGS. 4a, 4c, 
4e and 4g and four of the songs' attributes before system learning according to an embodiment of 
the present invention; and 

FIG. 4j is a diagram illustrating the relationship between the four songs in FIGS. 4b, 4d, 
4f and 4h and four of the songs' attributes after system learning according to an embodiment of 
the present invention. 

DETAILED DESCRIPTION OF THE INVENTION 

FIG. 1 illustrates an automatic preference detection system according to an embodiment 
of the present invention. As shown in FIG. 1, the present invention is a method and apparatus 
for the intelligent and automatic preference detection of media content files. This system is 
comprised of three major components: a user control point 105, a preference processing 
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subsystem 110, and a network-enabled entertainment cluster 115. This system infers a user's 
100 media content preferences, based on the user's 100 responses while media content plays, as 
well as on the responses of other users, and thereafter selects media content files to send to the 
user that the system determines the user 100 may like. In a preferred embodiment, this system is 
used to control media content files, such as songs in the format of music files, streamed over the 
Internet from an online media content database 135 to a user 100 of the system's computer 140, 
where the files are converted into a format playable on a device such as a stereo 145, where they 
are played. While a song plays on the stereo 145, the system uses a "fuzzy" logical reasoning 
scheme to determine to what degree the user 100 likes/dislikes the song and the particular 
attributes of that song. In the fuzzy logical reasoning scheme, the system infers that if the user 
100 utilizes the user control point 105 to forward to the next song, the user 100 did not like the 
song originally playing. For example, the earlier into the song the user 100 forwards to the next 
song, the more likely the system will infer that the user 100 disliked the song, as well as the 
various attributes of the song. The user control point 105 may be any device having the function 
of skipping from a song currently playing to the next song. A remote control with a "Next Song" 
button capable of skipping to the next song file may be used as the user control point 105. If the 
user 100 listens to a song the entire way through, the system will infer that the user 100 likes the 
song being played. 

I : oF , exainplg^ascore is calculated 120 for each song played by the system based upon 
how early the "Next Song" button isTittHtgtall. A song receives the highest score if it plays 
completely through. A song receives a low score if the^Ne2^tSong" button is hit while it is 
playing. The earlier into its play the "Next Song" button is hit, the lowerTfte-scQre. 
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The media content files may be streamed from a remote site. The media content files 
preferably contain attribute information. For example, when song files are streamed, each song 
may be categorized according to many attributes, such as the year the song was released, the 
band, the general type of music (pop, oldies, metal), where the band was from (England, 
America), etc. The more attributes that are associated with each song, the more accurate the 
system is at determining what songs the user 100 might like. 

ifter a score is calculated and processed 125, that score is added to a preference profile 
for the usek 100. The user's 100 preference profile, in conjunction with the preference database 
130 is used to determine which songs to send to the user 100. The preference database 130 
contains a file witftstfie user's 100 preference profile, as well as the preference profiles of every 
other user who has a profile with the system. The system analyzes the data in the preference 
database 130 and learns fromspatterns it detects. For example, if a user 100 typically listens to 
new wave hits from 80's Englisnbands all the way through, the system will continue to play 
other similar songs. If, for example, tnfeoiser typically listens to songs by Falco and the Human 
League in their entirety, the system will strehm songs by other artists with many of the same 
attributes, such as Frankie Goes to Hollywood, tostfie user 100. The streamed song files are sent 
from an media content database 135 to the user's netwrak-enabled entertainment cluster 115. 
This entertainment cluster 115 may include a computer 14iland a device for playing the songs, 
such as a stereo 145. In one embodiment, song files are downloaded by the computer 140, 
converted, and sent to the stereo 145 in a playable format. 

The automatic media content preference detection system may be used in conjunction 
with any content distributing system, including a music distribution system over the Internet. In 
such an embodiment, a user 100 is able to access a music distribution service ("MDS") site over 
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the Internet, where the user 100 may sign up for the MDS. FIG. 2 is a flow chart illustrating the 
initialization of the automatic preference detection system when a user 100 first signs up for the 
service according to an embodiment of the present invention. After a user 100 signs up 200 for 
the service by entering his name, billing address, etc., a preference profile is created 205 for that 
5 user 100. As the user 100 accesses and uses the system, continually updated information about 
the user's content preferences is stored in this profile. The information in this file is used to 
determine which songs to stream to the user 100. In order to make an initial educated guess 
about what types of music the user might like, the user may be asked certain preliminary 
questions 210, such as the user's favorite type of music, age, sex, where the user is living 
CI 0 (country or area of USA), etc. The system may also search 2 1 5 the user's hard drive and 

is J! 

H peripherals for MP3, Real Audio, wave files, or any other music file formats. If song files stored 



on the user's 100 hard drive and peripherals have a known title and/or artist stored in the file 

r 



name or somewhere within the file, this information is used to build an initial user preference 
profile. Next, all of the information from the preliminary questions 210 and the hard drive scan 
LI 15 215 is processed 220 and used to create an initial user preference profile. This data is then stored 
225 in the user's 100 preference profile in the preference database 130. 

After the user 100 has signed up for the MDS, the user 100 may begin using the MDS. 
FIG. 3 is a flow chart illustrating the processing that occurs when a user 100 is logged into the 
automatic preference detection system according to an embodiment of the present invention. As 
20 shown in FIG. 3, the user 100 must first log in 300 to use the MDS. Next, the user's 100 

preference profile is loaded 305 from the preference database 130. A program 3 1 0 then uses the 
user's 100 profile and the profiles of other users to determine which song to send to the user 100. 
The profiles of other users are used because patterns may appear in other profiles that may aid in 
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selecting a song the user 100 might like. For example, if a user's 100 profile shows an affinity 
for new wave pop synthesizer music from the 80s, then a techno song from a 90s group, such as 
New Order, may be sent to the user 100 if the profiles of many other users show affinities for 
both new wave pop synthesizer music from the 80s and for techno songs from 90s groups such 
5 as New Order. 

The program 310 typically selects a song that it has determined the user 100 is likely to 
enjoy. However, the program 310 will periodically select songs that it does not know whether 
the user 100 will like. For example, where a user's 100 profile indicates an affinity for 80s synth 
dance music, the program 310 may occasionally send an oldies, classical, or country song to the 
CJ0 user to see whether the user 100 likes the song. The newer and less-developed a user's 100 

•is. 
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N profile is, the more likely it is that the program will select such a song to be sent to the user 100. 
Next, the selected song is sent by the MDS to the user's 100 computer 140, where it is converted 
into a stereo-playable format and sent to the stereo 145, where it plays 315. The system learns 
320 from the user's 100 responses while the song plays. If the user 100 skips to the next song, 
y : 15 the system will infer that the user 100 dislikes that song and its associated attributes. The earlier 
O into the song the user 100 skips to the next song, the more the system will infer the user 100 
dislikes the song. After the song finishes playing or the user 100 skips to the next song, the 
program then selects 310 the next song to be played and the MDS sends it to the user's 100 
computer 140. This process continues until the user 100 logs out 325 of the MDS. Upon logout, 
20 the user's 100 updated preference profile is saved 330 in the preference database 130. 

FIG. 4a is a diagram illustrating the relationship between a first song and four of the first 
song's attributes before system learning according to an embodiment of the present invention. In 
Figure 4a, the song file, "Don't You Want Me," is categorized according to five attributes: title 
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400a, year of release 405a, general song style 410a (other examples include "oldies," "rap," 
"classical," etc.), artist 415a, and a specific song style 420a. While only five attributes are 
shown in FIG. 4a, many more may be used in different embodiments. Here, each attribute has 
been given an equal weight. In other embodiments, certain attributes such as general song style 
5 410a may be accorded greater weighting than other attributes. Each attribute in FIG. 4a is 
associated with each other attribute. This association is shown by the lines that connect each 
attribute to each other, 401a-404a, 406a-408a, 41 la-412a, and 416a. Each of these connections 
is also assigned a score. If no information is in the user profile for any of these attributes, the 
system does not know whether the user is likely to prefer this song or any of its attributes. When 
flO the system selects a song to send the user 100 that the user 100 listens to all the way through 
H without hitting the "Next Song" key on the user control point 105, the system learns that the user 
H : 100 likes the song, the connections between each attribute are strengthened, and the system 

m ■ ■ 

~£ assigns a high score for each of the song's attributes, and for each of the connections between 

r : each attribute. For example, if this system were to infer that a user liked a song comprised on 

fli . • 

^ 1 5 three attributes, A, B, and C. a high score would be assigned to each of these attributes. A high 

In 

Q score would also be assigned to each combination of these attributes: A and B, A and C, and B 

O 

andC. 

FIG. 4b is a diagram illustrating the relationship between the first song and four of the 
first song's attributes after system learning according to an embodiment of the present invention. 
20 FIG. 4b shows the result where the user 100 liked the song "Don't You Want Me" 400a. A high 
score is assigned to each attribute and to the connections between each attribute, as illustrated by 
the dark lines around and between each attribute. 
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FIGS. 4c, 4e, and 4g are similar to FIG. 4a. FIG. 4c is a diagram illustrating the 
relationship between a second song and four of the second song's attributes before system 
learning according to an embodiment of the present invention. FIG. 4e is a diagram illustrating 
the relationship between a third song and four of the third song's attributes before system 
5 learning according to an embodiment of the present invention. FIG. 4g is a diagram illustrating 
the relationship between a fourth song and four of the fourth song's attributes before system 
learning according to an embodiment of the present invention. 

FIGS. 4d, 4f, and 4h are similar to FIG. 4b. FIG. 4d is a diagram illustrating the 
relationship between the second song and four of the second song's attributes after system 
00 learning according to an embodiment of the present invention. FIG. 4f is a diagram illustrating 
the relationship between the third song and four of the third song's attributes after system 
learning according to an embodiment of the present invention. FIG. 4h is a diagram illustrating 
the relationship between the fourth song and four of the fourth song's attributes after system 

learning according to an embodiment of the present invention. 

k 

u 15 FIGS. 4d and 4h are similar to FIG. 4b, in that they show the connections after songs are 

JSS. 

Q played that the system inferred that the user 100 liked, as evidenced by the "Next Song" button 

Tar 

on the user control point 105 not being hit during their play. FIG. 4f, on the other hand, shows 
the result where the system inferred that the user 100 dislikes a song, where each of the 
connections between each attribute are weakened, indicating that the system infers that the user 
20 100 doesn't like the song. The earlier into the song the "Next Song" button is depressed on the 
user control point 105, the more the system will infer the user dislikes the song and each of its 
attributes. This system correspondingly assigns each attribute a lower score. 
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FIG. 4i is a diagram illustrating the relationship between the four songs in FIGS. 4a, 4c, 
4e and 4g and four of the songs' attributes before system learning according to an embodiment of 
the present invention. FIG. 4j is a diagram illustrating the relationship between the four songs in 
FIGS. 4b, 4d, 4f and 4h and four of the songs' attributes after system learning according to an 
5 embodiment of the present invention. As is evident in FIG. 4j, the connections between 

attributes in songs that the system inferred the user 100 liked are strengthened, and those in the 
song that the system inferred the user 1 00 disliked are weakened. For example, one song is 
associated with the year released attribute "1985" 405c. Since the system inferred that the user 
100 liked "Rock Me Amadeus" 400c, the song associated with this attribute, the system now 
10 infers that the user may like other songs associated with the "1985" 405c attribute. This is 

O 

® evidenced by the darker circle around "1985" 405c in FIG. 4j. The system also infers that the 
? s user may dislike songs from 1986, since that date is associated with "Human" 400e. 
^ Consequently, its score is decreased. This is evidenced by the lighter circle around "1986" 405e 
in FIG. 4j, than in FIG. 4i. 

f|| 15 The system infers that the user really likes songs from 1983 since the user did not skip to 

4$ the next song during the play of "Don't You Want Me" 400a and "Billie Jean" 400g, both songs 
C? associated with the 1983 attribute 405a. This association is illustrated by the dark circle around 
1983 405a, which is darker than the circle around 1985 405c in FIG. 4j. Also, the system does 
not know whether the user likes songs by the "Human League" 415a, since the user did not skip 
20 to the next song during the play of "Don't You Want Me" 400a, but did skip to the next song 
during the play of "Human" 400e, both of which are associated with the Human League 415a 
attribute. Consequently, songs with the Human League 415a attribute are no less likely to be 
played than they were before the learning began. However, songs with the 1986 405e attribute 
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are now less likely to be played since the user disliked the sole 1986 song "Human" 400e. Songs 
with the 1985 attribute are now more likely to be played than before, because the user did not 
skip to the next song during the play of the sole song with this attribute, "Rock Me Amadeus" 
400c. Songs associated with 1983 405a are even more likely to be played than 1985 405c songs, 
because the user did not skip to the next during the playing of either of the 1983 405a songs, 
"Don't You Want Me" 400a and "Billie Jean" 400g. The same process and reasoning applies to 
each other attribute. As is evidenced by FIG. 4j, the automatic media content preference 
detection system is capable of learning that the user likes a particular artist such as the Human 
League 415a, but dislikes a particular song, or vice- versa. The same is true with respect to each 
attribute. 

If the user had logged out 325 (see FIG. 3) of the system after the four songs had played, 
the newly learned information is stored 330 in the user's preference profile in the preference 
database 130. The next time the user logs in 300, the system will be more likely to play songs 
with the following attributes: 1983 405a, pop 410a, and new wave 420a. The system may also 
use the other user profiles in the preference database to make a more educated guess at what 
other songs besides those with the three aforementioned attributes the user might like to hear. 

The system may also be configured to handle a situation where a user 100 logs into the 
system, but then either walks away from his stereo 145, or simply does not pay attention to the 
songs being played. In such a scenario, it would be undesirable for the system to learn from the 
user's nonresponsiveness because any information learned may be inaccurate. Therefore, this 
system may be programmed to store learned information in a temporary file until the user 100 
hits the "Next Song" button, or some other button, such as volume, on the user control point 105. 
For example, after the user hits "Next Song" on the user control point 105, then the information 
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in the temporary user profile is moved into the permanent user profile file. The reason for this is 
in case the user isn't paying attention, or leaves his stereo, this system is intelligent enough to 
learn that after a certain number of songs have played in their entirety, that the user 100 is 
passively listening, if at all. Such information is not very useful in determining the user's 100 
music preferences, so it is never moved from the temporary user profile file. 

The speed at which the learning process occurs is determined by the program 310. A 
more "heavily weighted" program may be used when a fast learning process is desired. 
However, where a slower learning process is desired, a more "lightly weighted" program may be 
used. Where a heavily weighted program is used, the system quickly learns the user's 100 
preferences, and if the user's content tastes change, the system will quickly adapt to these 
changes. On the other hand, where a lightly weighted program is used, the system will more 
slowly learn the user's 100 preferences. However, where a lightly weighted program is used, 
any isolated instances of anomalies in the user's 100 responses (such as not wanting to listen to 
slow songs on rainy days or when the user is depressed, or where other people with different 
content preferences than the user are using the system), are insufficient to drastically change the 
user's 100 preference profile, because it changes only slowly over time. 

The program 310 in this system may also be programmed to periodically select songs 
based solely upon the time of day, week, year, etc. For example, in December, the program may 
be configured to select Christmas songs. If the program 310 learns that the user 100 does not 
like Christmas songs, it may start sending songs from other cultures, such as Jewish or Indian 
songs. Also, the program may be programmed to, based on the user's 100 preference profile, 
choose songs at a particular time that a radio station would also be playing. For example, where 
a user's profile indicates the user 100 likes some 80's music, even if the user 100 also likes other 
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styles, the program may be programmed to select only 80's songs on a Friday night, since there 

are radio stations that play only 80's music on Friday nights. Other time-sensitive programs may 

also be handled by the program 310, such as heavy metal Saturday nights, etc. 

While the description above refers to particular embodiments of the present invention, it 

will be understood that many modifications may be made without departing from the spirit 

thereof. The accompanying claims are intended to cover such modifications as would fall within 

the true scope and spirit of the present invention. The presently disclosed embodiments are 

therefore to be considered in all respects as illustrative and not restrictive, the scope of the 

invention being indicated by the appended claims, rather than the foregoing description, and all 

changes which come within the meaning and range of equivalency of the claims are therefore 

intended to be embraced therein. 
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